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Philadelphia,  PA  19104 


ABSTRACT 

Robust  Wiener  filtering  has  previously  been  considered  for  the 
single-input  (scalar)  case  where  there  is  no  channel  distortion  and  where 
the  signal  to  be  estimated  is  the  source  signal  itself.  In  this  corres- 
pondence.-wg’  extend  these  results  to  the  multiple-input  (vector)  case  where 
linear  channel  distortion  is  allowed  and  the  signal  to  be  estimated  is 
a  linear- filtered  version  of  the  source  signal.  The  result^are  obtained 
from  those  for  the  single- input  case  by  modifying  appropriately  the 
constraints  on  signal  and  noise  characteristics.  Such  a  modification  is 
motivated  by  an  examination  of  the  expression  of  the  mean-square  error  for 
the  optimum  filter. 


•This  research  ie  supported  by  the  Air  Force  Office  of  Scientific 
Research  under  Grant  AFOSR  82-0022. 
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I.  INTRODUCTION 


In  Nan-squared-error  estimation  of  random  signals  observed 

in  random  noise,  classical  theory  is  applicable  for  obtaining  optimum 
estimators  provided  signal  and  noise  second-order  characteristics^ are 
known.  When  these  characteristics  can  only  be  confined  a  priori  to  belong 
to  son  broader  classes  of  possibilities,  minimax  robust  estimators  may  be 
used  to  obtain  performance  which  is  always  at  least  as  good  as  an  optimum 
lower  bound.  In  [1]  a  minimax  robust  Wiener  smoother  was  obtained  for 
the  case  where  the  scalar  observation  process  was  an  additive  mixture  of 
the  desired  random  signal  and  random  noise.  The  result  in  II]  was  obtained 
for  signal  and  noise  power  spectral  density  classes  of  total-power-con- 
stralned  spectra  lying  between  given  upper  and  lower  bounds.  In  [2], 
this  work  was  extended  to  more  general  classes  of  allowable  spectra,  and 
causal  estimation  filters  were  also  considered.  Another  extension  of  the 
results  of  [1]  has  recently  been  obtained  [3],  applicable  for  cases  where 
signal  and  noise  are  possibly  correlated.  It  is  also  of  relevance  to  note 
that  the  robust  Wiener  filtering  results  obtained  in  [1]  are  closely  re¬ 
lated  to  robust  hypothesis  testing  results  obtained  in  [4]  for  bounded 
classes  of  probability  density  functions.  This  relationship  was  observed 
in  (2).  In  fact,  the  resulta  in  [4]  give  sore  details  of  the  results  and 
proofs  in  [1]. 


In  this  correspondence  we  obtain  another  useful  extension  of  the 
basic  robust  Wiener  smoother  result  in  11).  Ws  consider  here  the  case 
•here  a  linear  channel  (e.g.  measuring  instruNnt  or  transmission  channel) 
distorts  the  original  signal  a(t)  whose  power  spectral  density  is  modeled 
as  belonging  to  a  bounded  class,  so  that  the  observation  process  is  the 
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eua  of  a  distort ad  version  of  the  original  signal  and  noise.  In  addition, 
va  will  look  for  estimates  of  a  linear- filter ad  varslon  d(t)  of  s(t). 

In  this  work  wa  will  assume  that  the  channel  distortion  and  the  linear 
filter  generating  d(t)  froa  s(t)  are  specified.  The  case  where  the  channel 
distortion  is  lapredsely  specified  hut  signal  and  noise  spectra  are  known 
has  also  been  recently  considered  [5].  In  addition,  we  simultaneously  allow 
our  signal,  noise  and  observation  processes  to  be  vector-valued,  for  which 
we  use  spectral  models  which  are  direct  extensions  of  those  used  in  the 
scaler  case. 

The  results  that  we  establish  for  the  robust  filters  In  our  aore 
general  case  can  be  obtained  by  modifying  the  proofs  of  the  results 
obtained  for  the  simple  case  considered  in  [1,4].  Although  we  do  not 
attempt  it  here,  it  should  be  possible  to  include  signal  and  noise 
correlation  (as  In  [3])  in  this  more  general  scheme,  and  also  to  apply 
the  restriction  to  causal  filters  [2]. 

II.  PROBLEM  STATEMENT 

Consider  the  model  of  an  m- input  signal  estimation  problem  in  Figure 
1.  Here  _s(t)  is  the  original  signal  a-cooponent  real  vector  process,  and 

A 

it  is  desired  to  obtain  an  estimate  d(t)  of  a  desired  k-vector  d(t)  which 
is  a  linearly  filtered  version  of  s{t).  Specifically,  we  have 

d(t)  •  (1C1  *  s)(t),  -*Kt<»,  (1) 

I 

where  K  (t)  la  a  k  s  a  real  aatrix  and  the  M*N  denotes  matrix-vector 


convolution.  The  observation  process  j(t)  is  a  real  m -component  vector 


process  given  by 


X(t)  -  (CT  *  s)(t)  +  n(t),  — <t<-,  (2) 

T 

where  the  ■  x  a  real  matrix-valued  function  C  is  the  observation- 
channel  lapulse- response  and  n(t)  is  a  real  m-component  noise  process.  We 
assume  that  the  processes  j»(t)  and  n(t)  are  uncorrelated,  zero-mean  and 
vide-sense  stationary,  with  respective  power  spectral  density  matrices* 

S(u>)  and  H(o>).  Further,  we  assume  that  the  Fourier  transforms  K(u )  and 
C (w)  of  K(t)  and  C(t),  respectively,  exist  and  are  known.  Let  HTfo)  be 
the  k  x  a  frequency  response  matrix  of  a  linear  filter  (not  necessarily 
causal)  used  for  estimating  <l(t).  We  require  to  belong  to  the  class 

H  of  frequency  response  matrices  of  real  filters.  Then  the  resulting 
nean-squared-error  e(H;  S,  N)  d  g{  ld(t)  -  d(t)  ]T[<Ut)-d(t)]},  where 

A 

d.(t)  is  the  estimate,  can  be  shown  to  be  given  by 

e(H;  S,  N)  »  trace  j  [K(to)  -  C(to)  H0«>)]+*  S(w)(K(w)  -  C(w)  H(u)] 

+  H+(u)  N(u>)  H(to)  du),  (3) 


where  "t"  denotes  conjugate  transpose. 

Our  problem  is  to  find  a  alnlaax  robust  filter  characterized  by 
frequency  response  matrix  Hgtyt),  for  specific  classes  S  and  W  of  allow¬ 
able  spectral  density  aatrices  S(w)  and  N(u) ,  respectively,  so  that 


b€m  8 €s 
m€M 


e(H,  S,  N)  -  max  e(IL,  8,  B) 

8  €S  * 

mCm 


Hte  define  the  eutocorreletion  matrix  of  x(t)  as  Hx(t)xl(t*i)). 


(4) 


The  specific  classes  S  end  N  we  will  consider  ere  generalisations  to  the 
matrix  case  of  the  bounded  classes  of  power-constrained  spectral  densities 
considered  in  [1,  2],  and  for  these  a  mlnlmax  robust  filter  will  be  found 
which  satisfies 

win  nax  e(H,  S,  H)  ■  sax  nln  e(H,  S,  N) 

h€h  s€s  s€S  h€« 

u€m  h€m 

-  e(HR,  SR,  NR>.  (5) 

In  this  case  ^  is  the  frequency  response  of  the  optima)  filter  correspond¬ 
ing  to  the  pair  (SR,  NR)  £  S  x  W,  which  is  called  the  least-favorable  pair. 

III.  ASSUMPTIONS  AND  ALLOWABLE  CHARACTERISTICS 
We  assume  that  the  channel  characteristic  C(u)  is  of  the  form  Cq(u)I, 
where  Cq(u)  is  a  scalar  function  and  I  denotes  the  identity  matrix.  This 
assumption  holds  for  the  case  where  the  source  signals  all  pass  through 
the  same  observation  channel  and  do  not  Interfere  with  each  other  in  the 
observation  channel. 

Since  S(u)  and  N(u)  are  hermit lan,  non-negative  definite  matrices, 
they  can  be  decomposed  into  P.(s)A.(#)F^(s)  and  P  («)A_(u)P  *(«),  respect- 
lvely,  where  Pg (u)  and  PQ(ai)  ere  unitary  matrices  consisting  of  the  norm¬ 
alized  eigenvectors  of  S(u)  and  1(e),  and  (u) ,  AQ(w)  are  diagonal  matrices 
consisting  of  the  eigenvalues  of  8(w)  and  N(») ,  respectively.  Ms  will 
assume  that  P#(«)  •  Pft(«)  •  P(«).  This  assumption,  although  restrictive, 
does  hold  for  some  practical  situations.  For  example,  if  the  noise 
components  are  independent-  of  each  other  and  each  have  the  seam  power 
spectral  density,  (l.e.,  K(w)  is  diagonal  matrix  with  the  same  diagonal 
tens),  the  columxa  of  P(w)  can  he  set  to  be  the  normalised  eigenvectors 
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of  S(«).  v«  also  UMM  that  P(u>)  la  known,  ao  that  uncertainty  about 
S(u)  and  M(tt)  la  with  respect  to  the  eigenvalue  functions  A#(w)  and  A^Cu) . 

In  a  practical  application  of  these  results  one  would  start  with  a  nominal 
description  for  S  and  H  which  are  diagonalizable  by  the  same  matrix  P  ,  and 
than  allow  deviations  from  the  nominal  in  the  diagonal  terms.  While  this 
assumption  again  restricts  the  applicability  of  the  results,  it  is 
necessary  for  obtaining  the  explicit  results  that  we  give.  Several 
interesting  examples  can  be  given  in  which  such  restrictions  hold  [6].  This 
assumption  implies  that  the  a  components  of  the  observation  process  jr(t) 
can  be  decoupled  prior  to  further  processing. 

Let  X  ,  (to)  and  X  .  (u>)  denote  the  i-th  diagonal  terms  of  A  (w)  and 

si  m  s 

A  (u).  For  allowable  S(u) (-P(u)A  (u»)P+(u>))  and  H(«)C*P(u))A  (m)F*(«)),  we 
n  s  n 

assume  that  A  (u)  and  A  (u)  satisfy  the  following  constraints: 

8  n 

Vti<“>  -  -  xsui<w>  <6a> 

h  r  (6b> 

i-1  i  Ai*“>  X#1(w)dw  -  2vQs 
and 

Vi  <“>  :  >„!<“)  5  W  <“>  <'*) 

Jj^m)  Xni(«)/|  C0(w)|2  du>  -  2*q^  (7b) 

where  A^(w)  is  the  1-th  diagonal  tern  of  P+(»)K(u)K+ (u)P(u),  and  &  denotes 
the  set  of  all  w  such  that  Cq(m)  4  0.  Mote  that(  6b  )ls  a  power  constraint 
on  the  desired  signal  d(t),  since  the  left-hand  side  of  (6b)  can  be  shown 
to  be  tr  (lf («)g(w)K(w)dw*  Similarly,  (7b)  is  a  power  constraint  on  the 
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nolse  which  would  appear  if  the  eat lea ted  desired  algnal  is  obtained 

directly  by  passing  jr(t)  through  a  linear  filter  with  frequency  response 
X 

K  («)/ Cq(u),  the  "inverse"  filter.  Thus,  the  constraints  (6)  and  (7)  aay 
be  specified  by  a  priori  infomatlon. 

In  the  following,  we  will  find  the  robust  solution  for  the  allowable 
S(<o)  and  N(w)  just  defined.  As  will  be  seen,  the  results  can  be  obtained 
by  a  generalization  of  the  proof  of  the  results  In  [1,  2]. 

IV.  SOLUTION  FOR  ROBUST  FILTER 

Let  S^,  Nq  be  any  pair  of  spectral  density  matrices  in  the  classes 

5,  N,  respectively,  defined  in  Section  III.  Then  the  optimum  filter 

T 

frequency  response  Hq  (oj)  for  this  pair  is  given  by 

H0(u»)  -  l|C0(u>)|2So(u>)  +  N^u,)]-1  C0+(«)So(w)K(w);  (8) 

here  "t"  denotes  complex  conjugate.  Let  be  the  i-th 

diagonal  elements  of  A_  (u)  and  hAu)  in  the  decompositions  P(w)A  (u)P+(w) 
and  PGaJA^foJP^w)  of  SQ  (u)  and  N0(w),  respectively.  Using  (8)  in  (3)  and 
After  some  simple  matrix  manipulations,  we  get 


?  i  r  a  <  (w) 

!(ho»  s»  h>  - 1  h  i- - r224 - 

i-1  L  |C0(<-)|  A  <«)  + 


\ioi(w) 


i_  r  ,iV“)i2>Mi(“)  * . 

A1(M)  A_1(w)dw 

|c0<«)|2 
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Hou  this  can  be  rewritten  es 


where 


»<H0,  S,  H)  -  f  fe  U  -  ®oi(“)l2  Ai(“)Xai(“)d“ 
i-1  Jm 

fa 


2  A.  (u) 

.  («)  ]  - ?  X  .  (u)du, 

01  |c„(»)|2  "l 


Ai(u)*aot(u) 


Ai(“)x8oi(w)  +  iV“>W“>/lco<“>ri 


(10) 


(11) 


Note  that  the  optimum  filter  frequency  response  can  be  described  by 


Ho(«)  -  c^fc)  P(u)  Vw)  P+(w)  K(w) 


(12) 


where  H  (u>)  is  the  m  x  a  diagonal  aatrix  of  elements  H  ,  (w). 

O  Ol 

Defining  Agi(w)  *  Ai^Xsi^  and  lni(<*>)  “  IAj(w)/|Cq(m)|  jXni(») 
we  obtain  the  expression 


«(H 


’  *•  k>  ■  r ii'*' 


ol<"» 


+  lHoi(«))2  Anl(«o)d«,  (13) 

This  is  significant  because  for  the  simple  scalar  problem  where  the 
desired  signal  power  spectral  density  is  o(u),  noise  power  spectral  density 
is  q(u)  and  the  observation  process  is  the  desired  signal  plus  noise,  a 
filter  with  frequency  response  r (w)  gives  a  mean-squared-error  between 
output  and  the  desired  signal  component  at  the  input  of 

ti(«)d *  (14) 


e(r,  o 


n)  “37  jll“: 


r(u)r  o(»)  ♦  |r(«)|‘ 


lb*  robust  RUotr  filter  for  this  problem  when  a  end  r\  are  in  power- 
constrained  bounded  desses  wss  obtained  explicitly  In  [1]. 

He  see  then  that  in  our  cess,  in  light  of  the  definitions  for  our 
spectral  density  classes  [Eqs.  (6)  snd  (7)  ],  the  least-favorable  spectra 
rad  the  robust  filter  ray  be  obtained  directly  from  the  results  in  (1,  4] , 
st  least  for  the  case  m  ■  1.  For  this  case  (a  •  1)  we  have  thus  shown  how 
the  presence  of  a  non-ideal  channel  rad  an  arbitrary  definition  for  a 
desired  signal  (as  sons  llnear-filtered  version  of  the  original  signal) 
ray  be  included  In  the  problem  formulation  for  robust  Wiener  filtering 
by  defining  the  power  constraint  appropriately  [Eqs.  (6b)  and  (7b)].  For 
the  rare  general  case  a  >  1,  a  slnpl*  extension  of  the  proof  for  the 
scalar  case  in  [1]  gives  the  solution  for  the  robust  filter.  The 
extension  consists  of  alaply  using  the  rare  general  expressions  (6b) 
rad  (7b)  involving  as— t Sara  over  n  components  for  the  power  constraint; 
the  solution  for  the  1 seat-favorable  characteristics  is  again  obtained  in 
terra  of  two  constants  k|  and  hQ.  These  define  x8ri(«)  and  Xnri(w)  For 
the  least-fsuorabla  characteristics,  for  each  1,  exactly  as  in  the  scalar 
case.  This  extension  is  easily  proved;  one  way  to  justify  it  is  to 
consider  the  case  —we  In  a  scalar  case,  a  disjoint  frequency  subsets 
have  upper  snd  lower  spectral  bounds  defined,  rad  total  power  constrained. 
As  an  example,  if  E(«)  is  exactly  specified  rad  S(«)  -  P(w)A#(»)?+<«)  is 
constrained  by  (6),  we  find 

*  rfer  *“  «»>*•*»  **,*!<*)»««■)/ 
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Note  chat  A^(u)  aay  be  removed  everywhere  it  occurs  In  (15). 

It  Is  possible  to  consider  a  more  general  error  expression  of  the 
form  CpO**  S,  N)  ■  E{  [<i(t)-d(t)  ]TQ  [(i(t)-d(t)]}  where  Q  is  non-negative 
definite  and  Hermit lan,  and  generalize  the  above  results.  In  this  case 

4.  A 

the  A^Go)  have  to  be  taken  as  the  diagonal  elements  of  P  (u)K(u)QK  (u)P(u) 
A  complete  proof  of  these  results  is  given  in  [6]. 

V.  SUMMARY 

In  this  correspondence,  we  have  extended  earlier  results  on  robust 

Wiener  filtering  which  had  been  obtained  for  the  scalar  case  when  there 

was  no  channel  distortion  and  when  the  signal  to  be  estimated  was  the 

source  signal  Itself.  The  choice  of  allowable  characteristics  considered 

here  was  motivated  by  an  examination  of  the  expression  for  e(H  ,  S,  N). 

o 

Although  the  constraints  (6b)  and  (7b)  are  not  put  on  the  power  spectral 
density  matrices  of  the  source  signal  and  input  noise  directly,  they 
are  meaningful  in  applications.  Results  for  the  robust  solution  are 
obtained  directly  from  the  previous  results  [1,  4]  by  noting  the  corres¬ 
pondence  between  the  roles  of  Aj(«)X#^(w),  A^(w)Xn^(w)/ |Cq(w) | ^  and  the 
roles  of  the  densities  considered  in  [1,  4]. 
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